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1. Introduction 



Abstract. Let (G, G') be a type I irreducible reductive dual pair in Sp(W / r). We assume 
that (G, G') is under stable range where G is the smaller member. Let p be a genuine 
irreducible (g, if)-module. The first main result is to show that if p is unitarizable, then 
the full local theta lift p' — O(p) is an irreducible (g' , K ')-module and thus equal to 
the local theta lift 9(p). The second main result is to show that the associated variety 
AV(p') and the associated cycle AC(p') of p' is obtained via the notion of local theta 
£f) ■ lifts of nilpotent orbits and cycles from those of p. Finally we obtain some interesting 

(g, if)-modules whose if-spectrums are isomorphic to the spaces of global sections of 
' vector bundles on nilpotent if^-orbits in p* 

in 

Let W R be a symplectic real vector space. Throughout this paper (G, G') will denote 
a Type I irreducible reductive dual pair in Sp(VU R ). We assume that (G,G') is under 
p/ { stable range where G is the smaller member. Such dual pairs are listed in Table [T] in 

Section 12.11 Let p be a genuine irreducible (g, i^)-module. The first main result is to 
show that if p is unitarizable, then the full local theta lift p' = O(p) is an irreducible 
(g', i^')-module and thus equal to the local theta lift 9(p). The second main result is to 
show that the associated variety AV(p') and the associated cycle AC(p') of p' is obtained 
via the notion of local theta lifts of nilpotent orbits and cycles from those of p. Finally we 
obtain some interesting (g, i\~)-modules whose i^-spectrums are isomorphic to the spaces 
^ ■ of global sections of vector bundles on nilpotent i\c-orbits in p*. 
O . 

1.1. Let Sp(PU R ) be the metaplectic double cover of Sp(W / R ). For any subgroup E of 
Sp(VU R ), let E denote its inverse image in Sp(W R ). We choose a maximal compact sub- 
group U of Sp(VU R ) such that K := G fl U and K 1 := G' fl U are maximal compact 
subgroups of G and G' respectively. The choice of U is equivalent to a complex structure 
on W R with a positive definite Hermitian form (, ). Then U = U(W, (, )) is the unitary 
group on the underlying complex vector space W. 

We follow the notation in [T2] closely. The Fock module & of the oscillator representa- 
tion of Sp(lF R ) is realized as the space C[W] of complex polynomials on W. Let q denote 
the minimal U-type of & ' . It is a one dimensional character of U acting on the space of 
constant functions in C[W]. Let q\g denote the restriction of q to E for any subgroup E 
ofU. 

Let q and K denote the complexified Lie algebra and maximal compact subgroup of G 
respectively. Let p be an irreducible admissible (g, if)-module. By (2.5) in j 1 2] . 

(1) ^/(n^ eH om ojI .(^,p) ker ip) ~ p ® Q(p) 

where O(p) is a (g', i<"')-module called the full (local) theta lift of p. Theorem 2.1 in [12] 
states that if O(p) 7^ 0, then 0(p) is a (g ; , i^')-module of finite length with an infinitesimal 
character and it has an unique irreducible quotient 9{p) called the (local) theta lift of p'. 
Moreover #(pi) and 6*(p 2 ) are isomorphic irreducible admissible (g', i^')-modules if and 
only if pi and p 2 are isomorphic irreducible admissible (g, i\~)-modules. 
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It is a result of [28] that in the stable range 8(p) is nonzero. This partly generalizes a 
previous result of [UJ which states that if p is irreducible and unitarizable, then 9(p) is 
nonzero and unitarizable. 

In order to state our first result, we need to exclude following special case. 

(f) The dual pair (G, G') = (Sp(n, R), 0(2n, 2n)) and p is the one dimensional genuine 
representation of Sp(n, R). 

We state our first main result. 

Theorem A. Suppose (G, G') is in stable range where G is the smaller member. Let p 
be an irreducible unitarizable K) -module. We exclude the case (f) above. Then 

Q(p) = 6(p) 

as (q' , K') -modules. In other words, 0(p) is already irreducible and unitarizable. 
The proof is given in Section 12.31 

In Case (f), 6(p) is reducible by the Lee's appendix in [IS] . 

The above theorem is useful because in applying see-saw pairs argument, one has to 
use Q(p) instead of 9(p). For example, we could deduce a formula for the A^'-types of 0(p) 
in Proposition 12. 2[ 

1.2. Before stating other results, we briefly review the definitions of some invariants of 
a A)-module. See Section 2 in [30J for details. 

Let g be a A)-module of finite length and let C F C • • • C Fj C Fj + i C - • • be 
a good filtration of g. Then Gr g = Fj/Fj-i is a finite generated (5(p), A)-module 
where S(p) is the symmetric algebra on p. 

Let srf be the associated A c -equivariant coherent sheaf of Gr^ on p* = Spec (5(p)). 
The associated variety of g is defined to be AM(g) := Supp(£/) in p*. Its dimension is 
called the Gelfand-Kirillov dimension of g. It is a well known fact that AV(g) is a closed 
subset of the null cone of p*. 

Let AV(g) = Uj=i ®j sucn that Oj are open K c -orbits in AV(g). By Lemma 2.11 in [30] . 
there is a finite (<S(p), A c )-invariant filtration OC<s#oC---C^C---C stf n = stf of 
srf such that s^xf stf\-\ is generically reduced on each Oj. For a closed point Xj G Oj, let 
i x . : {xj} ^ Oj be the natural inclusion map and let K Xj be the stabilizer of Xj in K c . 
Now 

Xxj ■= 0z(ix J )*(MM-i) 

is a finite dimensional rational representation of K x . . We call \ Xj an isotropy representa- 
tion of g at Xj. Its image [Xxj] in the Grothendieck group of finite dimensional rational 
AVmodules is called the isotropy character of g at Xj. The the isotropy representation is 
dependent on the filtration but the isotropy character is independent of the filtration. 

We call { {Oj , Xj, Xxj) '■ J ' — 1; • • • j r } the set of orbit data attached to the filtration srfj. 
On the other hand, { (Oj, Xj, \Xx]) : J = 1 , - • - , ^ } is independent of the filtration and 
we call it the set of orbit data attached to g. Two orbit data are equivalent if they are 
conjugate to each other by the K c -action. We define the multiplicity of g at Oj to be 
m(Oj, g) = dim c \x 3 and the associated cycle of g to be AC(^) = Y7j=i m (@j, Q)[@j]- 

In summary the associated variety, the associated cycle and isotropy character(s) are 
invariants of g, i.e. they are independent of the choices of nitrations. 

We add that the above invariants of g and of its contragredient g* are related by a 
Chevalley involution C on G. See [TJ or Appendix [Bj 
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1.3. Now we describe a result about the associated variety of 0(p). 

Let g = t©p and g' = f'©p' denote the complexified Cartan decompositions of g and g' 
respectively. There are two moment maps 

(2) p* -^Up'*. 

The maps <fi and are given explicitly in Table EJ For a -invariant closed subset S 
of p*, we define the theta lift of S to be 9(S) = <f>' S) , which is a ^-invariant closed 
subset of p'* (see Appendix lA.ip . Let 

(3) N(p*) = { x G p* | G K^~x } 

be the null cone of p* under the K c -action. Let (p*) be the set of nilpotent K c -orbits 
in p*. We define N(p'*) and ^X K ' c (p'*) in the same way. By Theorem [Ql 6(3) C N(p'*) 
if S C JV(p*). 

Since 0(p) is of finite length, the associated variety AV(0(p)) of 0(p) is a closed 
subvariety of N(p'*). 

Theorem B. For any real reductive dual pair (not necessary of type I or in stable range). 
We have an upper bound of the associated variety ofQ(p): 

Av(e(p)) c e(AV(p*))). 

The proof is given in Section 13.61 

The above theorem is a correction to Proposition 3.12 in Nishiyama-Zhu [25] . 

1.4. We assume (G,G') is in the stable range where G is the smaller member. Given 
O G Dlx c (P*)! it is a result of |1] and that there is a unique O' G yi K > (p'*) such that 
O = 6(d). We say that O' is the theta lift of O and we denote O' = 0{O). Moreover, 

0:^ C (P*)^9^(P'*) 

is an injective map preserving the order on both sides given by closure relations, i.e. 
6(0 2 ) C 0(Ch) if 2 C OT. See Theorem m 

Definition 1.5. VFe define following notion of theta lifts of objects in stable range. 

(1) Let c = m j[Oj] be a formal sum of nilpotent orbits. We define the theta lift of the 

cycle c to be 9(c) := J2j m j[®(Oj)}- 

(2) Let (0,x,Xx) be an orbit datum where O G ^XIk c (P*), x £ O and Xx is a finite- 
dimensional rational K x -module. Let O' = 0(O). Fixing points x G O, w G W, 
x' G O' such that <fi(w) = x and <fi'(w) = x' , we define a group homomorphism 
a: K' x , — > K x in flHol) . We define the theta lift of the orbit datum (0,x,Xx) to be 
(O', x', Xx') where 

Xx' ■= sift® ($\jt x ®Xx)°oc. 

x' 

We denote 9(0,x,x x ) = (0',x' ,Xx')- Similarly we define the theta lift of (0,x, [Xx]) 
to be (Q',x', [xx'})- We denote 9(0,x, [ Xx ]) = (0',x', fry]). 

Theorem C. Suppose (G, G') is in stable range where G is the smaller member. Let p be a 
genuine irreducible (g, K)-module. Suppose { (Oj, Xj, [xxj]) '■ J ' = 1> • • • , r } is the set of or- 
bit data attached to p* . Then 0(p) is attached to the set of orbit data 
{0(O,.r r \ Xj ):j 1 r}. 

The next theorem is a corollary of Theorem 
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Theorem D. Suppose (G,G') is in stable range where G is the smaller member. Then 

AV(0(p)) = 0(AV(p*)) and AC(6(p)) = 0(AC(p*)). 

In particular if p is unitarizable, then AV(0(p)) = 0(AV(p*)) and AC(0(p)) = (AC (/?*)) 
by Theorem L4l 

The proofs of Theorems O and [D] are given in Section 14.61 In these two Theorems, 
we do not require that p* is unitarizable. We will show in the proof of Lemma 14.71 that 
every 0(O j) has the same dimension equal to dim AV(0(p)), i.e. the Gelfand-Kirillov 
dimension of 0(p). However there are examples where 0(p) is reducible and 8(p) has 
smaller Gelfand-Kirillov dimension than that of 0(p). In particular AV(0(p)) does not 
contain any 0(Oj). 

Theorem [D] overlaps with the previous work of [23] and [32] where G is a compact 
group. It also extends the work [25] where p is a unitarizable lowest weight modules. 

For a (g, i^)-module g of finite length, we define V c (g) to be the complex variety cut 
out by the ideal Gr (Ann W ( fl )£>) in where Gr (Ama u ^g) is the graded ideal of Ann W ( )p 
in GiU(g) = C[g*]. Alternatively V c (o) is the associated variety of the (g©fl, G c )-module 
U(g)/ Aim u( g )Q. It is an Ad*G c -invariant complex variety in q* whose dimension is equal 
to 2dimAV(^). By Proposition EH V c {g*) = V c {q)- 

We recall that (G, G') is a type I irreducible dual pair in stable range where G is the 
smaller member. Correspondingly we have two moment maps 

(4) *^lf R ® R C^4g". 

For an Ad*G c -invariant complex subvariety S of q*, we define 9 C (S) = (po'^c^iS). This 
is an Ad* G' c -invariant complex subvariety of q'*. We state a corollary of Theorem ID1 

Corollary E. Suppose (G, G') is in stable range where G is the smaller member. Then 

Vc(e(p)) = c (v c (p)). 

The proof is given in Section 14.81 

The above corollary overlaps with Theorem 0.9 in [29J where Prezbinda proves the 
identity V c (#(p)) = #c(V c (p)) for dual pairs and unitarizable p satisfying some technical 
conditions. 

We would like to relate a recent result of [8] where Gomez and Zhu show that the 
dimensions of the generalized Whittaker functionals of the Casselman-Wallach globaliza- 
tions of p and O(p) are the same. It is a famous result of [2T] that in the p-adic case, the 
dimensions of the spaces of generalized Whittaker functionals of an algebraic irreducible 
representation are equal to the corresponding multiplicities in its wavefront cycle. Theo- 
rem [D] together with |8J could be interpreted as an evidence for the corresponding result 
for real classical groups. 

1.6. In Sectional we consider representations whose i^-spectrums are the same as the 
global sections of if c -equivariant algebraic vector bundles on nilpotent orbits. We will 
show that theta lifts in stable range preserve such property. 

Let O G 9Tft- c (p*) and x G O. Let n : K c — >• O be the natural projection map given 
by n(k) = (Ad*k)x. For a finite dimensional rational ^-module (xx,V x ), we define a 
-fTc-equivariant pre-sheaf on O by «£?({/) = (C[it~ l {U)} ® c V x ) Kx for all open subsets U 
of O. By [3J, ££ is a sheaf. We define a (C [O], K c )-module 

Indgxx = (C[A] ® V x ) Kx = H°(0,J?). 
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If (O, x, Xx) appears in the orbit data attached to a filtration of a finite length (g, K)- 
module, then we have 

(5) «5f is generated by its space of global sectionsInd if c T4- 

For the rest of the paper we will always assume that data (0,x,x x ) satisfy 
We exclude following special cases: 

(G, G') = (Sp(2n, R), 0(p, q)) where p = 2n or q = 2n; 

(G, G') =(Sp(2n, C), 0(4n, C)). 

Theorem F. Suppose (G, G') is in the stable range with G the smaller member exclud- 
ing flttl)- Let p be an irreducible admissible genuine (g, K)-module. Let (0,x,Xx) be an 
orbit datum satisfying ([5]) such that, as K c -modules 

p* = Ind^X;,. 

Let (0',x',Xx') be the theta lifting of (0,x,Xx)- Then, as K' -modules, 

(6) 0(p)=Indgx a /- 

x 1 

The above theorem is a corollary of Proposition 15.11 which is a statement on the level 
of (S(p), i^ c )-modules. 

1.7. We relate our results with a conjecture of Vogan on geometric quantizations and 
unipotent representations. 

Definition 1.8 (Definition 7.13 in [30J ) . Let O E 9t* c (p*) and x E O. The stabilizer K x 
acts on the cotangent space T*0 = (t/t x )*. We define a character of K x by 

(7) 7 a (fc) = det(Ad(fc)| ( e /(B) k E K x . 

An algebraic representation of the double cover K x is called admissible if 

(8) Xx(exp(X)) = 7 ,(exp(X/2)) - Id VX E t x . 

An orbit datum (O, x, [Xx]) i> s called an admissible orbit datum if Xx is an admissible 
representation of K x . An orbit O E (p*) is called admissible if it is part of an 
admissible data. A representation Xx of K x satisfying dHJ) is uniquely determined by its 
character [x x ] ■ 

A (g, X)-module p is said to have X-spectrum determined by an admissible orbit datum 
(0,x,[ Xx ])if 

(9) P \~ Kc = Indgx, 

as a K c -module. Such a representation p could be considered as a quantization of the 
orbit O. In Conjecture 12.1 in [30], Vogan conjectured that, for every admissible or- 
bit datum (0,x, [Xx]) satisfying certain technical conditions and dO has codimension at 
least 2 in O, then one can attach a unipotent representation p to this orbit datum and 
satisfies 

In Section [6], we will show that the notion of admissibility is compatible with theta lifts 
in stable range. 

Proposition G. Suppose (G, G') is in stable range where G is the smaller member. Let 
(0,x, \Xx\) be an admissible orbit datum for group G, Then its theta lift 0(O, x, [Xx]) is 
also an admissible orbit datum for the group G' . 
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The above is a consequence of Proposition 16. 11 

Suppose (G,G') is in stable range where G is the smaller member and excluding ( Iff] ). 
Let p be an irreducible unitarizable (q, i^)-module whose i^-spectrum is given by some 
admissible orbit datum (O, x, [Xx])- It follows from Appendix IB .21 that p* is an irreducible 
unitarizable (g, K)-modu\e whose .fT-spectrum is given by the admissible orbit datum 

C(0,x, [x,]) := (C(0),Ad*C(x),[ Xx oC]) 

where C is a Chevalley involution on G. By Theorem lAl Theorem [F] and Proposition IG] 
9{p) is an irreducible unitarizable (gf, if')-module whose K'-spectrum is given by the 
admissible orbit datum 9(C(0,x, [Xx]))- 

1.9. Finally we construct a series of candidates for unipotent representations. Let 

Go, Gi, G2, • • • , G n , ■ ■ ■ 

be a sequence of real classical groups such that each pair (G n , G n +i) is an irreducible 
type I reductive dual pair with the smaller member G n excluding (Iff]). Let po be an 
irreducible genuine one dimensional representation of (g ,K ) such that p o | 0o i s trivial. 
By changing G\ if necessary, such character always exists. It is clear that p is attached 
to the admissible data (0, 0, p | (^ ) c ) - 

Let C n be a Chevalley involution on G n . Let p n+ i = 9(p n ) and (O n +i, x n+ i, Xn+i) — 
, x n , Xn))- The following theorem follows from Theorem [D] Theorem [F] and Propo- 
sition [G] 

Theorem H. The (g„, K n ) -module p n is an irreducible and unitarizable representation 
attached to the admissible orbit datum (O n ,x n ,Xn)- Moreover, as K n -module, 

p n = Ind ( !" )c X n. 

The above theorem generalizes a result of Yang [33] where he proved the above theorem 
for pi. A similar result on Dimixer algebras is given in (2]. 
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2. The /^-spectrum of unitary representation in stable range 

2.1. Let (G,G') be a type I irreducible reductive dual pair in Sp(PU R ). We list them in 
Table [1] below. We say it is in stable range with G the smaller member if it satisfies the 
last column in the table. 

We follow the notation in |12j . By Fact 1 in [T2], K' is a member of a reductive dual 
pair (K',M) in Sp(PU R ). We form the following see-saw pair in Sp(H^ R ): 

(10) G' M 




K' G 



The complex Lie algebra of M has Cartan decomposition m = m^ 2 ' -* ©m^ 1 ' 1 -* ©m*- 0,2 ^ where 
m^ 1 ' 1 ) is the complexified Lie algebra of a maximal compact subgroup M^ 1 ' 1 ^ of M. 
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G G' 


Stable range 


Case R 


Sp(2n,R) 0(p,q) 
0(p,q) Sp(2n,R) 


2n < p,q 
p + q < n 


Case C 


U(ni,n 2 ) U(p,g) 


n± + n 2 < p, q 


Case H 


U (znj ^P V P, <?) 
Sp(p,?) 0*(2n) 


n < p,q 
2{p + q) < n 


Complex groups 
Table 1. S 


Sp(2n,C) 0(p,C) 
0(p,C) Sp(2n,C) 

table range for Type I 


An < p 
p < n 

dual pairs 



Let H be the space of i^'-harmonics in *3f ~ CfW 7 ]. As an M^ 1 ' 1 ) x fT'-module, 

(11) H = ^a®a' 

where each a is either zero or an irreducible genuine M^ 1 ' 1 ) -module uniquely determined 
by a'. 

Proposition 2.2. Suppose (G, G') is in stable range where G is the smaller member. Let 
{p,Vp) be an irreducible genuine (q, K) -module. Then 

©001* = (&rn a/ o-' = (n®p*\ R ) K 

a'eK' 

where m a i = dim Horn^ (cr, p). 

If p is the Harish- Chandra module of a discrete series representation of G, the above 
proposition is Corollary 5.3 in |llj . 

Proof. Let L(o~) denote the (full) theta lift of a', which is a unitarizable lowest weight 
module of M. The pair (G, G') is in stable range implies that 

(12) L(a) = U(m) ® M ( m (i.i)© m (o,a)) a ^ U(g) ® U (t) a 

as a 0-module. The second equality follows from Eq. (3.5) in [T2]. Applying this to the 
see-saw pair (flOlh we get 

(13) m a i = dimHom^ ; (cr', p') = dimHom g ^(L(a), p) = dim Horn^ (a, p). 

This proves the proposition. □ 

2.3. Let (p, V p ) be an irreducible unitarizable Harish-Chandra module of G. For the rest 
of this section we will prove Theorem |A] 

First we recall Li's construction of 9{p) [T7]. Define 

(«i <S>Wi,v 2 <S> w 2 )p* = / (p*(g)v 1 ,v 2 ) p , (u}(g)w 1 ,w 2 ) aj dg 

' G 



for all v x <8> Wi , v 2 ® w 2 G V p * <8> All pairings are done in the completion of the Harish- 
Chandra modules. We set 



R = Rad«, >£) = { $ G V p * ® ^ | ($, = 0, V$' G V> 



Let 

ff=(V>®^)/Rad((,)^. 

We claim that H ~ 6*(p) as irreducible unitarizable Harish-Chandra modules of G' . Indeed 
Li [T7] uses smooth vectors in the definition of (, )^» and likewise defines if 00 = (V r p *) c 
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^°°/Rad(, )£. It is shown that H°° = 6(p)°°. Clearly H C H°°. Since H is ^'-finite and 
dense in H°°, it is the Harish-Chandra module of H°°. This proves our claim. 



We refer to (<J,V a ) in (|TT|) and L(cr) in (IT21) . Then L(a) is an irreducible unitarizable 
Harish-Chandra module of M and IV = ffi o Lfcr) ® cr'. 
Taking the cr'-isotropy component, we define 

(v i <g> iwi, u 2 ® w 2 )p» = / (p*(g)vi,v 2 ) p * (g ■ w 1 ,w 2 } L{u) dg <g> w { G V p * <g> L(er). 

We also define 

R' = Rad((, )£) and #(</) = (V> <g> L(cr)) //?'. 

In this way 

We consider following embeddings: 
(14) 

H(a>) = (V p * <g> L{a))/R! <^-> Hom G (( ® L{a)°°, C) Hom fl ^(V> <g> L(a), C) 
where is given by 

(15) $ ^ ($' i-> ($', V$' G V> ® L(<r). 

The last term on the right hand side of (JT3J) is 

Rom ajK (V p *®L(a),C) = Hom g# (L(o-), Hom c (V p ,, C)) 
= Hom s ^(L(a),y p ) 

(L(a) is if-fmite, so its image in Hom c (Vp*, C) is infinite i.e. in V p ) 
= Eom R {V a ,V p ) (by(Tl2D) 
= Hom c ((V>®K) X ,C). 

The isomorphism between the first term and the last term in above equalities is given by 
restriction. By (TT3]) 



dim H(a') < dimHorn^(V^., V p ) = dim Hom^,(cx', @(p)) 
and it is finite. We will show that (Tl4|) is an isomorphism and this will prove that 

e(p) - h. 

We write V a = ®i anc ^ ^p* = ©jej ®i as direct sums of irreducible .fT-modules. 

Then 

Hom x ® K, C) = Hom x ® C) = Hom c ((£>,- ® A) X , C). 

Let {c?a} be an orthonormal basis of D\ and let {<i^} be a dual basis of Dj ~ Z^*. 
Then (£)j £g> -D/) K is spanned by d = J2\ d\ ® <^a- It suffices to show the pairing between 
V p * <g> L(cr) and d in (fl5|) is non- vanishing. 

Globalization of L(a). We exhibit a globalization of the Harish-Chandra module L(a). 
Our references are [15] and [H]. We refer to M in fflOl) . Let 



Rol(M,M^ 1 \V a )= { f:M^V a 



f is analytic, 

f(gk) = k- l f(g) VgeM,keM^, 
r(X)f = VI6 m* - 2 *. 
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Here r(X) denote the right derivative action. Let { Vi } be an orthonormal basis of 
V a C L(a). Then 

(!6) v ^ (^9^Y1 Vi )h(a) 

defines an injective (m, M( 1 ' 1 ))-module homomorphism f : L(a) ->■ Hol(M, M^ 1 ' 1 ); V^). 

For any g G M, there are unique z(g) G m^°' 2 \ &;((?) G M^ ,l \ z'(g) G m^ 2 ' ) such that 
g = exp(z(g))k(g) exp(z'(g)). Let f2 denote the image of z. Let £ : M — > M A SI be the 
composite map. Then Q = {z(g) G m (0,2) : g G M} ~ M/M^ = M /M^ is a bounded 
open subset in m^ ' 2 ) and 

M C exp(fi) • M^' X) • exp(m {2 ' 0) ). 

Let Hol(f2, Va) denote the space of holomorphic functions on f2 with values in V a . We de- 
fine P : Hol(M, MW, Va) ->■ Holg2, V a ) in the following way: For / G Hol(M, M^- 1 ), V a ), 
we set P/ G Hol(Q, V a ) by P/foAft 1 - 1 )) = k(g)f(g). Then P isa bijection. 

Let ( = Po( : L{a) — > Hol(fi, V a ). The space of lowest M^'^-type V a in the image 
of £ is the space of constant functions on fl Let C[W ' 2 )] denote the space of polynomials 
on m^ 0,2 ). Then £(L(cr)) is the linear span of 

{j)x((d) |pGC[m (0 ' 2 VeV;} 

because L(a) is a full generalized Verma module. This translates into £(L(cr)) consists of 
finite sums of functions in Hol(M, M^ 1 ' 1 ); V^) of the form 

(17) 0->p(C(0))x (£(«)($)) (V^GM) 

where p G C[m (0 ' 2) ] and t> G V CT C L(cr). 
Let 

C(G, X; V a ) = { / G C(G, Va) | /(<?*;) = k-'fig) Vk e K } 
be the space of continuous sections. We have a map £ : p* — >■ C((7, X; V^) given by 



w i — ^ 



Let fi - G/K denote the image C(G) in SI. We have P : C(G, K; V a ) ->■ C(fi ; K) 
defined by the same formula as P. We denote £ = Po°£o- There is a positive function m(x) 
on fl such that m(x)dx is a G-invariant measure on fi . Let w G £(c) such that = 
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p x £(di). Let v = d\. Then !)®wGp'0 L(a). 

v^w^d* x ®d x J = jj^ (P*(9^)v, d* x ) p , (g^w, d x ) L(a) dg 



' G A 



G 



(a™)(9),Wl)(9)) v<T dg 

P(C(9)) mdi)(g)), (Udl)(g))) Va dg (By (HBO 
p(((gK)) (adi)(gK)^ (dt)(gK)) Vcr dgK 

G/K 

p(x) (l(d 1 )(x),l (d* 1 )(x)) m(x)dx 
u 



(18) = / p(x)f(x)dx 

where f(x) = ^(di)(x),^ Q (dl)(x)') v m(x). The function f(x) is a nonzero continuous 

function because /(0) = (C^OWjIoK)^))^ m (°) = (di,di)m(0) = m(0) + 0. We 
extend /(x) to the boundary of Qq by 0. 

By Li [IT], the integration ( JIB"]) is absolute convergent for every p e C[m ( - ' 2 - ) ]. This is 
the place where we exclude the Case (f) in Section 11.11 

It remains to show that ffl8~]) is nonzero for some p(x) G C[m^ 0,2 ^]. By [11] . the restric- 
tion of C[m ( - ' 2 ' ) ] to the compact subset f2o forms a dense subset in C(fi ) under sup-norm 
by the Stone- Weierstrass Theorem. Since f(x) is nonzero, J-^p(x)f(x) dx is nonzero for 
some p(x) by the dominated convergence theorem. This completes the proof of Theo- 
rem El 

3. Natural filtration and corresponding (<S(p), ^-module 

3.1. Let (C7, G') be an irreducible Type I dual pair as in Tabled! In this subsection, we 
do not assume that it is in stable range. Let p be an irreducible genuine (g, i^)-module. 
Let p* denote its dual (contragredient) ($j, i^)-module and let p' = 0(p) denote its full 
theta lift. For any module g, denote its underlying space by V e . 

Proposition 3.2. We have 

Q(p) £* (p* ® W\ K S ((p* ® W\f . 

Proof. Since K is compact, the last equality follows if we identifying K- invariant quotient 
as .ff -invariant subspace. 

Now we prove the first identity. Let jV = fl^ e Hom B K (W,p) ker ?/> as in ([1]). We have 

Hom c ((V> <8> &) S>K , C) = Hom g , x ((V> <8> ^) 0>K , C) 
= Hom^V,. ®&,C) = Horn Hom c {V p *, C)) = Hom g V p ) 

(19) = Hmn^^Vp). 

The second last equality follows from the fact that & is .fT-finite and Hom c (V p *, C)^_ finite = 
V p . Starting from (1191) . we reverse the steps by replacing with f jY in (pQ) and we get 

Hom c ((V p , ® &) 0jK , C) Hom c ((l/ p . <g> &/^) s ,K, C) 

Hom c ((V> ®V p ® V p ,) S! k, C) Hom c (V>, C) 

This proves the proposition. □ 
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3.3. The Fock model & is realized as complex polynomials on W, so <3f = W3i is filtered 
by degrees. Let q : & — > V p <g> V p > be the natural quotient map. Let (r, V T ) be a lowest 
degree F-type of (p, V p ) of degree j . Let © V" T ' be the joint harmonics. We define a 
filtration on V p , = UjVj by Vj = 

We view V p * = Hom c (V p , C)^_ finite . Let V T * C V p * be an irreducible F-submodule 
with type r* which pairs perfectly with V T . By Theorem 13 (5) in [10], the lowest degree 
F-type has multiplicity one in p. Hence V T and V T * are well defined. 

Let I £ I 7 ,-* be a nonzero linear functional on V p . We identify 1^/ with l{q{^)). Then 
we have shown in a previous paper [19] that /(q , (^ 0+ j)) = V/,, 2 <. Likewise we define a 

filtration on V" p and V^* by { Vj := W,($j)K } and { V* := } respectively. We will 

clarify the relationships between them in Appendix IB. 41 

We define a filtration on W = V p * <g> ^ by 

(20) w,= £ ic®^. 

2a+6=j 

By Proposition ^. 21 we have a quotient map rj : W — > W Bj _k = p' and it induces a filtration 
Fj = ry(W i0+2i ) on p'. 

Lemma 3.4. The filtrations Fj and Vj on (p',V p >) are the same. 
Proof. We consider the maps 



p* ® ^ -% (p* ® ((p* ® = p'. 

Since l(q'(& jo+j )) = V' j/2] , we have r/(K* ® &j +2j) = Vj. Hence V/ C Fj. On the other 
hand, for a + \ b/2\ = j, 

v{v:®%, +b ) = vK(q)v t * ® & jo+b ) 

= r)(V T * ®U a (g)^j 0+ b) (Since acts trivially on the image) 

C T](V T * © ^ +6+2a) C Vj. 

By ()20|) . Fj C Vj and this proves the lemma. □ 
Taking the graded module, r] induces a mapQ 

(21) Gr p* <g) 5(j0 Gr ^ » Gr (pr p (W)) Grp'. 

We recall that U is a maximal compact subgroup of Sp(H 7 R ). Let sp(W R ) © C = u © s 
denote the complexified Cartan decomposition. We recall the minimal one dimensional 
U-type £ of the Fock model IV . For k £ U, q~ 2 (k) is equal to the determinant of the 
action on W. We extend q to a («S(s), U)-module where s acts trivially. We will continue 
to denote this one dimensional module by q. In this way, Gr <3f = ©($a+i/$a) — ? • C[W] 
where U acts geometrically on C[W]. Since (G,G r ) is a reductive dual pair in Sp(W R ), 
we denote the restriction of q as a (5(p), F)-module by q\g. Similarly we get a one 
dimensional (iS(p'), F')-module 

Let A = q\^GrV p * and B = ?|~.,GrV^. Since p is a genuine Harish-Chandra module 

of G, A is an (S(p), F c )-module. Similarly B is an (S(p'), F^-module. 



1 Warning: By definition X G p acts on Grp* by —AT, since -A x 1 = — 1 x X for X G p in the image. 
Note that there is a if-equivariant algebra isomorphism e: S(p) — > S(p) extending X M> —X. It's easy 
to see that e*(Grp*) — > Grp* given by a n> (— l) J a for a G Gr^p* is an isomorphism of <S(p)-modules. 
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We take into account q, and the fact that K acts on A® C [W] reductively and preserves 
the degrees. Then (121]) gives the following (iS(p'), i^')-module morphisms 

(22) A® 5(p) C[W] (A® S (p) C[W]) K ^q\~) (Gr(pr p (W))) A " = B. 

The merit of introducing q is that the K ■ K' action on Gr W descends to a geometric 
K c ■ K' c action on C [W] . 

Lemma 3.5. Suppose (G, G') is in the stable range where G is the smaller member. 
Then r/ in ( 122"]) is an isomorphism, i.e. 

B = (A® 5(P) C[W])^ 

as (iS(p'), K' c ) -modules where S(p') and K' c act on C[W]. 

Proof. We recall the harmonics % in (ITT]) . Let "H = q~ lr H. Under the stable range 
assumption C[W] = S(p) <S> H as an («S(p),iT) x i^'-module. Since A = q\^V p *, as 
ii~'-modules, 

(A ® s(p) C[W\) K = (A ® s{p) (5(p) <g> -H)) K = (A| x <S "H) A = B|^ 

by Proposition I2.2[ The map f] is a surjection and B is an admissible fT'-module so the 
lemma follows from the equality of .ff' -types. □ 

We recall the moment map in (j2j): 

p * ^4p'*. 

For the dual pairs in Table [TJ we describe explicitly the moment maps in Table [2] below. 
Here J<i v is the skew symmetric 2p by 2p matrix 



G 


G' 




P* 


p" 








0(ix;) 




Sp(2n, R) 


0(p,g) 


M p ,„ x M,,„ 
(AS) 


Sym„ x Sym„ 
(A T A, B T B) 




U(ni,n 2 ) 


U(p,g) 


Mp ni X Mp n2 X Mq tTll X Mq n2 

(A,B,C,D) 


Mni,n.2 ^112,111 

(A T _B, D T C) 


M p , g X Mg.p 


0*(2n) 


Sp(p, <?) 


M2p. n X M2q,n 

(A,B) 


(A T J 2p A,#J 2 ,B) 


M 2p ,2g 


Sp(2n,C) 


0(p,C) 


Mp,2n 

A 


Sym 2n 


Altp 



TABLE 2. Moment maps for non-compact dual pairs. 



Since the filtration on p* (resp. p') is good, the graded module A (resp. B) is a 
finitely generated (S(p)-module (resp. «S(p')-module). Let srf (resp. 88) be the associated 
coherent sheaf on p* (resp. p'*). The associated quasi-coherent sheaf of A <8s(t>) C[W] on 
p'* is (fi'^cjf srf . Let SB be the associated quasi-coherent sheaf of B on p'*. 

3.6. Proof of Theorem\E By definition, AV(p*) = Supp(^) and AV(6(p)) = Supp(^). 
By (122]) . SS is a subquotient of the quasi- coherent sheaf fi^cf)* so 

Supp(^) C Supp(0',0W) C 0'(Supp(0* I c/)) C 0'(0- 1 (Supp( I ^))) = 0(Supp(jzO). 

This proves the theorem. □ 

The above proof also applies to Type II reductive dual pairs. If AV(p) is irreducible, 
then the above proposition is Proposition 3.12 in [25] . 
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4. Associated cycles 

Throughout this section, we suppose (G, G') is in the stable range where G is the smaller 
member. Let p be an irreducible genuine (q, -fT)-module. The objective of this section 
is to prove Theorems ICl and ID1 For a point or a subvariety Z of p*, p'* or W, we let %z 
denote the natural inclusion map. 



4.1. We will first state and prove Lemma [4.21 This is a key lemma which could be view 
as an enhance of Section 1.3 in [23]. One may skip its proof in the first reading. 

Let O G %l Kc {p*) and O' = 0{O). Pick a w G W such that x = <f)(w) G O and 
x' = 4>'{w) G O' . Let a: K' x , — > K x be the map defined by (1351) . Then pre-composition 
with a defines a map a* from the set of ^-modules (resp. characters of K x ) to the set 
of i^.,-modules (resp. virtual characters of K'J). 

Lemma 4.2. Let A be a (cfOJ, K c ) -module. Define an (S(p r ), K' c ) -module by 

B = (C[W] ® 5(p) A) K ^. 

Then B is a (CfO 7 ], K' c )-module. 

I. i t stf and 3$ be the quasi- coherent sheaves on O and O' associated to A and B respec- 
tively. Then we have the following isomorphism of K' , -modules: 



= a*(C 



In particular, dimi*,3§ = dimz*=e/ if A is finitely generated. 

Proof. See [2D]. Let Z = be the set theoretic fiber. We consider following diagram 



{ x } < { w } 




By Lemma 1X81 C[Z] = C[W] ® s{p) C\0). Then 

B = (C[W\ ® 5(rt A) Kc = (C[W) ® 8(p) C[0] ® cm A) Kc = (C[Z] ® cCT A) Kc 



as an (S(p% ^)-module. By LemmalASl C[0'\ = C[Z] I<C so B is a C [C]-module. 

Recall x' G O' . Let Z x i = Z x-^t { x' } be the scheme theoretical fiber. Since we are in 
characteristic zero, Z x > is reduced. Let m(x') be maximal ideal in S(p') corresponding to 
the point x'. 
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Since taking -invariant is an exact functor and <p'*(S(p')) is K c -invariant, we have 
i* x ,M = (5(tOM^))®5^)(c[Z]® cp jil)^ 

= (C[Z] ® m A) K */(m(x')c[Z] ® m A) Kc 

C[Z] ® m A)/(m(x')C[Z] ® m A)j 

{C\Z]/m{x')C\Z})® m A) Kc 
(23) = (C[Z x ,]® cm A) K °. 

Let := i* Zx/ (<P\z)*^, then c[Zj\ ® cm A = 2?(Z X ,). By Corollary ESI Z x , is a 
K c x fC^-orbit generated by w. Let S w = StabK c xK' ,(w). By fl36|) . S w = K x x a K x , = 
{{a{k'), k') e K x x K' x ,}. Then by Theorem 2.7 in [3]* 

Si?*) = Ind^J', x 

x' 

where x is the fiber of 3? at w. By the above commutative diagram, we have ^-module 
isomorphisms 

where (a(k'), k') E S w — K x x a K' x , acts on i x &/ via the natural action of a(k') on 
Putting the above into f[2"B"j) gives 

= mz X ')) Kc = (Ind^ x X 5', x) Xc = P« 

or 

as i^-modules. We prove the right isomorphism: Let / G (Ind^ 5', x)^ c - Then 

/ : K c x K' x , -> X satisfies /(&, fc') = X (a(A0)/(«(^) -1 ^ 1) = x(a(^))/(M)- Hence / 
is uniquely determined by /(l, 1). This proves the right isomorphism. It also completes 
the proof of the lemma. □ 

4.3. Let p' = Q(p), A = ?|^GrV> and B = ?|~*Gr B(V P ) as before. For a subset Z 
of p*, we let I(Z) denote the ideal of S(p) vanishing on Z. 

Proposition 4.4. There is a finite filtration = Ao C • • • C A; C A^ + i C • ■ ■ C A n = A 
of (5(p), K c )-modules with the following property: For each I, there is a K c -orbit Oi such 
that the annihilator ideal of Ai/Ai_i in S(p) is the ideal I{0{). 
In particular A//A/_i is a C[Oi]-module and (JILi ®i = AV(p*). 

Remark. We warn the orbit 0\ may not be connected since K c may not be connected. 
Furthermore a Oi may not be an open orbit in AV (/>*)■ 



Proof. The proof essentially follows that of Lemma 2.11 in [30] . 

Let Kq be the connected component of K c . The set of isolated primes of A is finite 
and discrete. The connected group K acts trivially on it. 

Let a e A such that Q> = Anns( P )(a) is an isolated prime of A. Let Ai = S(p)K c a 
be the («S(p), K c )-submodule in A generated by a. Let V{&) be the subset of p* cut out 



2 Let m(w) be the maximal ideal of w in C[Z] and m(x) be the maximal ideal of x in C[C]. Then the 

map <j> : w x gives a C[C]-algebra isomorphism: L : C[0]/m(x) ^» C[Z]/m(w) = C . The group 

S w acts on the left hand side while the group K x acts on the right hand side. These two actions are 
compatible in the sense that for (a(k'), k') € S w C K x x K' x ,, we have L o a(k') = (a(k'), k') o L. 

Similarly K' c acts on C[Z] <8>cfo] A via translation on C[Z] while Kc acts via translation on Z and on 
A. Then X = (C[Z]/m(w)) ® c[5] A £ (C[0}/m{x)) ® c[ ^ A = i* x si . Let (a(k'),k') G Then it acts 
on the right hand side via its natural action of a(fc') on '. 
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by QJ. Since V(@) is irreducible and i£o-invariant, it is the closure of single ifo-orbit Oq. 

Let O x = K c O . 

We claim that Ann^p^Ai) = I{0\). Indeed, 

Ann 5(p) (A 1 ) = f| Ann 5(p) (k ■ a) = f| k ■ ® = f| [k] ■ ® 

keK c keK c {k]eK c /Ko 

= n u [k].vm = i(o 1 ). 

[k]£K c /K 

The above second last equality holds because it is a finite intersection of prime ideals. 
The last equality holds by the definition of 0\. This proves our claim. 

Now, we could construct A/ and 0\ inductively by applying the above construction to 
the (5(p), A' c )- m odule A/A;_i. This procedure will eventually stop because A is a finite 
generated module over Neotherian ring S(p). □ 

Let A; as in Proposition 14.41 and let A' = A;/A;_!. It is a finitely generated module of 
C[Oi] and we let srf 1 be its associated coherent sheaf on Oi. 

By Lemma EH B = (c[W) ® 5(p) A)^ c . Hence B, = (c[W] ® S (p) &i) Kc is a (S(p),K c )- 
equivariant filtration of B. We set B' = B//B/_!. By Theorem IA.7l in Appendix |A~6j 
is flat. Combining this with the exactness of taking K c -invariants, we get 

(24) B ; = B,/B { _! = (C[W\ <g> 5(|)) (A/A,^))^ = (c[W\ ® S ( P ) A l f c - 
Let M\ and SB be the associated coherent sheaves of B^ and B' respectively. 

4.5. We define a partial ordering on the if c -orbits by containments in the Zariski clo- 
sures. Let {O^, . . . , Oi r } be the set of (distinct) maximal nilpotent i^ c -orbits appearing 
in Proposition 14.41 For each Oi in this set, we fix a representative Xj G Ox and define a 
K x . -module 

(25) x fa,Gn*) = i* x y. 

o l .=o 1 

Let rrij = dim c x{ x j-> Gr The integer rrij is independent of the choice of Xj G 0\ .. 
Moreover rrij ^ 0. Indeed all -fQ -modules in the right hand side of (1251) is non-zero 
because supp (g/ 1 ) = ^Ann^A') = Oi = O tj . 

Recall that A = q\^GrV p *. Let 

(26) x*i = s\~ 1 ®x(x j ,GT*/). 

Then { (£>,. , Xj, Xxj) } is the set of orbit data attached to the nitrations given by Propo- 
sition 14.41 

Now the associated cycle of p* is 

r 

(27) AC(p*) = AC(A)=]£m^- 
and the associated variety AV(p*) = U[ =1 C^. 

4.6. Proof of Theorems^ and\^ First we observe following lemma. 

Lemma 4.7. Let { Oi : j — 1, . . . ,r } be the set of all distinct (open) maximal K c -orbits 
in AV(p*). Then {6(Oi 3 ) : j = l,...,r} forms the set of all distinct (open) maximal 
K' c -orbits in 9(AV(p*)). 
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Proof. By Theorem lA~2im the map 9: VIk c (P*) ->■ ^l K ' c (p'*) is injective so all the 0(0^ )'s 

are distinct. We also have 0(AV(p*)) = ^(^(U^i^)) = ULi^TO = ULi W 
It suffices to show that dim0(C\) = dim0(AV(p*)). 

By Theorem 8.4 in |30j, every A c -orbit Oi j generates the same G c -orbit O c in q*. 
Indeed O c is the variety cut out by Gr (Ann w( fl ) (/?*))• 

Nilpotent K c -orbits for classical groups are parametrized by signed Young diagrams. 
In particular the underlying Young diagrams of different O^'s are the same and they 
have the same dimension equals to \ dim c O c • By [26] , the signed Young diagram of the 
orbit 6{Oi) is obtained by adding a column to the signed Young diagram of Oi y Hence 
every K' c -orbit 0(0^) generates the same G' c -orbit 0' c in q'* and has dimension equals 
to ^dim c O' c . Moreover it is known that (for example by [KP] or [4J), O' = 6 c (O c ) 
where 8 C was defined after fll]). We have shown that dim 8 '(Oi k ) = dim0(AV(p*)) and this 
completes the proof of the lemma. □ 

Let 0\ = did). By TheoremE AV(p') C \J j=1 9(0^ = \J r j=1 0{.. 
Now we apply Lemma 14.21 to B' and we have 

X (*;,Gr^):= il,@ l = a*(*;V) 
O t =Oi. o,=o t . 

3 J 

where x'j and ctj are x' and a in the statement of the lemma respectively. 

Since A = <^GrV^. and B = q\ ]?,Gr Q(V P ), the isotropic representation of 0(p) at x'j 
with respect to the filtration 3§i is 

Xx'. = s\k, ® x{x'j,Gv3§) = q\ Rl g> x(xj, Gr ,sf) o aj = q\ Rl ® <g) Xx s ) ° «i- 

In particular, Xx'. 7^ since Xx- 7^ 0. Therefore {{O'i.^x'^Xx') '-3 — 1> • • • > r } forms the 
set of orbit data attached to the filtration =5^. This proves Theorem O 
Now 

r r 

AC(0(p)) = Y J dim X x' j [0[ j ] = J2 m Am~)] = 0{AC(ff)). 

3=1 3=1 

This proves Theorem [D] □ 

4.8. Proof of Corollary [El Let p' = 0(p). From the proof of Lemma [4.71 O' = 9 c (O c ). 
This gives 

G" c AV(p') = 0^ = 9 C {0~ c ) = 9 C (G c AV(p)) = C (V c (/>)). 

Although p' may not be irreducible, we claim that V c (p') = G" c AV(p') and this would 
prove the corollary. First V c is an additive map, i.e. V c (B) = V c (A) U V c (C) for every 
exact sequence 0— > A — )■ B — )■ C — > 0. This is well known to the experts, which follows 
by taking the graded version of 

Ann w(g / ) (A)Ann w(0 / ) (L7) c Ann u(gl) (B) C Ann w(a ,)(A) n Ann w(g /)(C). 

Next let p[, . . . , p' s be all the irreducible subquotients of the (g', A')-model p' of finite 
length. Using Theorem 8.4 in [30] again, 



V c (Annp') = |J V c (Annp' fc ) = (J G' c AV(p^) = G" c |J AV(p'J = G" c AV(p'). 
fc=i fc=i fe=i 



This proves our claim and Corollary [El 



□ 
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5. The ^-spectrum equation 



We retain the notation in the previous sections where we assume that (G, G') is in 
stable range where G is the smaller member. The objective of this section is to prove 
Proposition 15.11 which implies Theorem [Fj 

Let x G O and let (xx-, V x ) be a finite dimensional rational representation of K x as 
in Section [1.61 By Theorem 2.7 in |3J, there is an equivalent of categories between the 
category of rational representations of K x and the category of fC c -equivariant sheaf on 
O ~ K/K x . Let Jzf be the i^ c -equivariant sheaf on O corresponding to Xx- We assume 
that «£f is generated by its global sections (c.f. ()5])). Let io '■ O — > p* denote the inclusion 
map and let srf = (io)*^?- We also set 

(28) A := #/(p*) = Sf(0) 

as an (<S(p), K c )-module. Then V x = i* x srf = A/m(x)A and AC {A) = (dimV x )[0}. 

Let O' = 0(O). Let w e W such that x = <p(w) e O, x' = <p'(w) e O' in 0. Let 
a: K' x , — > K x be the map defined in ([35]) in Appendix lAl Let (x^/, V x >) = (xx ° a i Vx) be 
the representation of K' x ,. Let Jzf' be the i^'-equivariant sheaf on O' corresponding to the 
representation x' x > °f K'x" Let : O' —> p'* denote the inclusion map. We define the 
[S{p'),K')-modu\e 

B = (A <g> s(p) C[W]) K ° = (A ® m C[0] ® S (p) C[W}) K - = (A ® m C[Z]) K - 

H) K 



IndgK 



as before. By the proof of Proposition 12.21 we have (A\k 



B\k> as K'- modules. 



Proposition 5.1. The sheaf (io 1 )*^' is the coherent sheaf corresponding to the (S(p'), K')- 
module B . 

Before we begin the proof of the above proposition, we show that the proposition implies 
Theorem [Fj Indeed by f l2"B"|) . A\ K = q\^V p *\^ as if-modules. Therefore 



{A\ K ®U) K = 
(io')^'(p'*) 



B\ 



K> 



H) K (by Proposition I 

(by Proposition 12.21 again) 
(by Proposition 15.11) 



Ind^ V x i. 



= ££'(0') 
This proves Theorem [Fl 

Proof of Proposition f3T7l Let Y : = W x p O. By Lemma [A.81 Y is a reduced scheme. We 



consider following diagram where Z° 



-\0')<1Y. 




I'D 

p* <— ^- W p' 
Since <fi is flat, Proposition 9.3 in Chapter 3 in [9J gives 

<j>*{io)*&=(iY)MYY2 > 

as sheaves on W . Let be the qusi-coherent sheaf on p'* associated to B. Let J3 
(c\)\y)*5£ . By the exactness of taking K c -invariant, 
every open set U C p'*. 

i) B = @(p'*) = (£(Y)) K <= = (H°(Y, B)f c . 



(U) = (£(<ff-\U) n Y)) 1 ^ for 
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ii) We recall Z° = O^') -1 ^') n Y. It gives 

®{0) = (H°(Z°,£)) Kc . 

iii) From the proof of Lemma 14.21 we have 

x' 

Thus the proposition is equivalent to 3§{p'*) = SS{0'\ It suffices to prove that 
(29) H°(Y, J2) = H°(Z°, £}). 

Indeed Jzf is locally free on O so J is locally free on Y . Hence 

depth^ = depth 

for any y G Y. Let dZ° = Y — Z°. Let H l dzo (£3) ( res P- ^az»(^)) be the cohomology 
group (resp., cohomology sheaf) of Y with coefficient in £1 and support in dZ°. By 
Lemma lA.101 in Appendix lAl codim(Y, dZ°) > 2. By Lemma lA.8l (ii). Y is a normal 
scheme so it satisfies Serre's (S2) condition. Therefore, 

depth y ^ y = depth^y^ > min { dim £?y, v , 2 } = 2 

for all y G dZ°. By a vanishing theorem of Grothendieck (see [3 Theorem 3.8]), 

^ Z o(3) = for i = 0,1. 

By Proposition 1.11 in [7J, a spectral sequence argument implies 

H°{Y,£J) = H°{Z°,£). 

This completes the proof of Proposition 15.11 □ 

6. Admissible data 

In this section we will show that the theta lift of an admissible data is still an admissible 
data. We continue to assume that (G, G') is a dual pair in stable range where G is the 
smaller member. 

Let O be a nilpotent K c -orbit in p* as in (J2J). Let O' = 0{O). Let w G W such that 
x = <p(w) G O and x' = <f)'(w) G O' . Let a: K' x , -)> K x be the map defined by fl35|) . 
Proposition [G] follows from the next proposition. 

Proposition 6.1. Suppose (G,G') is in stable range where G is the smaller member. 
Let Xx be an admissible representation of K x as defined in Section \T7J\ We set 

Xx> ■= ® MjL ®Xx) °0£. 

x' 

Then \x' is an admissible representation of K' x ,. 

Proof. We have to verify that 

^(exppf')) = det(Ad(exp(X72))| (t7 r /) *) MX' G t' x , 

Since \x is admissible, by taking square of above equation, it is easy to see that it reduces 
to the following lemma. 

Lemma 6.2. As t' x ,-modules, 

A top (W) = (A top («/«.) «) ® s\k> ® ° «)• 



INVARIANTS AND A"-SPECTRUMS OF LOCAL THETA LIFTS 19 

Proof. Let E = K' c K c w, F = and F' = Let S w := Stab^' xK c ( w ) = 

{ (k',a(k') | k! G K' x , } = K' x ,. We have following two exact sequences of S^-modules: 

> T W F' ► T W E ► T x ,0' > 

and 

► T W F > T W E ► T x O > . 

Here S w acts on T x O (resp. T x iO') via the projection S w — > K x (resp. S w ^> K' x ,). Since 
S w = K' x ,, the above are also exact sequences of A^,-modules. 

By Corollary \AM i ) T vjF' = t The ^-action on f\ op t is trivial since t is reductive. 
Therefore 

(30) A top T x'0' = A top t^c <g> A top T W F 

as ^./-modules. Since we are in the stable range, 4> : W — > p* is a submersion at every 
point w G W. We have following exact sequence of A^,,-modules: 

► T W F > T W W > T x p* > 0. 

Since T x p* = p* and t' x , acts trivially on f\ op p*, we have 

(31) tf op T w W = f\° p T w F. 

Combining ([20]), (J3T]), T„W = W, T^C S t/t x and T^O' = we have 

(32) A top (*VO = ( A top ° «) ® A top W. 

If we view u G U c as a linear transformation on VF, then 

<? _2 (w) = det(u\ w ). 
Hence the action of k' G K' x , on f\ op W is 

det((fc', = ^,{k') ® (^| x 2 o a (A/)). 

Putting this into (13"2"]) proves the lemma and Proposition 16. 1[ □ 

Appendix A. Geometry of theta lifts of nilpotent orbits 

Throughout this appendix, we let (G, G') denote a Type I irreducible reductive dual 
pair in Sp(H / R ) in stable range where G is the smaller member as in Tabled) 

A.l. We recall the moment maps defined in (|2J). The following fact is true for every 
reductive dual pairs, not necessarily in stable range. The moment map factors through 
the affine quotient: 




By the First Fundamental Theorem of classical invariant theory, c[W] c is a quotient of 
S(p'), i.e. iw/K c is a closed embedding. For every K c -invariant closed subset E C W, its 
image in W/K c is closed by Corollary 4.6 in [27]. This implies that <fi'{E) is closed in p'*. 
Hence for every K c -invariant subset S G p*, 0(S) := (j)' ((j)" 1 S) is a -invariant closed 
subset of p'*. 

We define the null cone of p* under K c -action to be 

N(p*) = { x G p* | G AV^} . 

Let Vl Kc (p*) be the set of nilpotent A c -orbits in p*. Define N(p'*) and %l K > (p'*) in the 
same way. It is well known that 6{S) C N(p'*) if S C N(p*). 
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We summarize some results in (26], [I] and [24] . 

Theorem A. 2. Let (G,G') be a reductive dual pair in stable range as in Tabled 
(i) For any nilpotent K c -orbit O in p* , there is a nilpotent K' c -orbit O' in p'* such that 

0'(0- 1 (O)) = O 7 . 

This defines an injective map 9: 9T^ c (p*) — > 9T^(p'*) given by O ^ O' . This map 
is called the theta lifts of nilpotent orbits, 
(ii) Theta lifting of nilpotent orbits preserves closure relation, i.e. if Oq C O then 
6(O ) C 9{0). □ 

We refer to Table [2] where W is written as a product of matrices. Let W° be the open 
dense subset of elements in W whose every component has full rank. Before we discuss 
the finer structures of orbits, we state following lemma. 

Lemma A. 3. Let (G,G') be a reductive dual pair in stable range as in Tabled 

(i) We have ^(^(W )) = W°. 

(ii) For any x' G <fi'{W°), fl W° is a single K c -orbit where K c acts freely. 
(Hi) For any x G <p(W°), <fi~ l (x) fl W° is a single K' c - orbit. 

(iv) We have one-to-one correspondences of the following sets of orbits 

{ K c -orbits in (f>(W°)} <B- { K c x K' c -orbits in W° } { K' c -orbits in <fr'(W°) } 
0(C) 4 — i C H- <j)'(C) 

O i — y <p- l {0)nw° 

<p-\o') = <p-\o') nw° 4 — i a. 

Proof. The proof for each dual pair is similar so we will give the proof for the first pair 
in Table [1] and leave the other cases to the reader. 

Consider (G, G') = (Sp(2n, R), 0(p, q)), W = M p<n x M q>n , p'* = M p>g and p, q > 2n. 
For (A, B) G M Pi „ x M qtTl = W, <p'(A, B) = AB T has rank n if and only if A and B have 
rank n. This proves (i). 

Let x' G <p'{W°). Let (A, B), (A',B') G ^(xT) n W°. We have 

(33) AB T = (j>\A, B) = x' = <j)'(A', B') = A\B') T . 

Here x', A, B, A' and B' are all rank n matrices. Since the column space of A (resp. 
A') is same as the column space of x', we may assume that A = A' by the action of 
K c = GL(n, C). If we interpret A : C n — > C p as an injective linear map, it is clear 
that (I33p implies B T = B' T . This proves that (A,B) and (A',B') are in the same Kc- 
orbit. This proves /_1 (x') fl W° is a single -fT c -orbit. 

Next suppose k G K c stabilizes (A,B). Hence Ak T = A. Since A is an injective map, 
k = id. This shows that the K c -action is faithful. This proves (ii). 

Let x G (f>{W°). Let (A,B), (A',B f ) G <p-\x) n W°. We have 

(34) {A T A, B T B) = <f>(A, B) = x = <f>(A', B') = (A' T A', B' T B'). 

Since KerA = Ker A' = 0, there is an o G 0(p, C) such that A = oA' by Witt's theorem 
(for example, see [121 Theorem 3.7.1]). The same argument applies to B and B'. Hence 
_1 (x) n W° is a single orbit of K' c = 0(p,c) x 0(q, c). This proves (iii). 

Part (iv) follows from (i), (ii) and (iii). □ 

Theorem A. 4. Let (G, G') be a reductive dual pair in stable range where G is the smaller 
member as in TableUl Let O' = 0(O). Then 

(i) 4)'- l {0') = (j)^(O) n W° = (j)'~\0') n ^(O) is a single K c x K' c -orbit. 

(ii) <t>{<ft-\0)) = O. 
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The orbits in and could been calculated explicitly in all the cases 

(for example from Table 4 in [3]). Then (i) and (ii) could be checked directly from these 
data. 

We will sketch a simpler proof below. However, we could not avoid to use following 
fact: <fi~ l (0) has a unique open dense K c x i^-orbit (see Theorem 2.5 in [23] for a proof 
via deformation argument). 

Sketch of proof of Theorem \A.J\ For every O G %Ik c (p*), Lemma [A.3( iv) shows that 
(f)- l (0) n W° is a K c x -orbit and O' = ^{^(O) n W°) is a K' c -orbit. By Lemma 
EOlfiv) again, <jr\0) HW° = <j>'- l {0') HW° = ^{O'). Since (j)-\0) n is open 
and nonempty in _1 ((9), it is the unique open dense K c x K' c -orbit. Hence (9 3 
<//(<FHP) n r) = fii^iO)) D £>'. This shows that £>' = 0(0). Clearly ^(C) n 
_1 (C?) is a non-empty /f c x lf£ -invariant subset of the K c x J^-orbit /_1 ((9'). This 
proves 4f-\0) = <f>'-\0') n ^H^)- Thi s gives (i). 

By Lemma [Of iv). = $~\0') n W° is a single K c x AT£ -orbit. Hence £> = 

n r) = 4>{<tf-\a)). This proves (ii). □ 



Corollary A. 5. Let {G,G') and O' = 6{(D) as in Theorem A. 4 We fix a w G W such 



that x = (j)(w) G O and x' = (j)'(w) G O' . Let K x = Stabtf c (aO and K' x , = Stab^(x'). 
Then 

(i) , " 1 (x') = f'^nr = ^(x^n^iO) = <f>'- 1 (x , )r\(l>- 1 {0) is a single K c -orbit 
where K c acts freely. 

(ii) There is a (surjective) group homomorphism 

(35) a: K' x , — > K x such that k' ■ w = a(/c /_1 ) ■ w Vfc' G K x . 
In particular, 

(36) Stab KcX ^H = K x x a K' x , := { (a(k'), k') \ k! G K' x , } . 

Proof. By Theorem IA.4H ) 0'~ 1 (x / ) = <f/~ 1 (x r ) fl W° and Lemma lA.3f ii) states that this 
is a single i^ c -orbit where K c acts freely. This proves (i). Fix k! G K x >, k' ■ w G <p'~ x (x'). 
By (i), there is a unique k G K c such that k ■ w = k' ■ w. Since x = 4>{k' ■ w) = <fi(k ■ w) = 
k ■ <p(w) = k ■ x, we have k G K x . We define a(k') = k~ l . It is straightforward to check 
that a is a group homomorphism and (136]) holds. 

Now we prove that a is surjective. Fix k G K x . Since k ■ w G </> _1 (a;) fl W°, there is an 
element k' G such that k' ■ w = k ■ w by Lemma [A.3( iii). It is clear that that k' G K' x , 
so k ■ w = a(fc') -1 ■ w. Note that i<r c -action on 0' _1 (a;') is free, we have a(k')^ 1 = k, i.e. 
a is surjective. This completes the proof of (ii) and the corollary. □ 

A. 6. We discuss the scheme theoretical properties of (j2D- 

Let R = W - W° be the set of matrices without full rank. Let Af = _1 (O) C W° and 
dAf :—JJ' — Af. By Theorem \KM A/" is a single K' c -orbit, AT = ^(O) and dAf = Rf)Af. 
We state some well known geometry properties of the null fiber 

Theorem A. 7 ([5] [16] [23] )• Let (G,G') be a real reductive dual pair in stable range as 
in TableUl 

(i) We have C[W] = H®S(p) where % is the space of K' c -harmonic. In particular, the 
map 0: W — > p* is a faithfully flat morphism. 

(ii) The scheme theoretical fiber W x p » { } is reduce^, i.e. Af = W x p » { }. 

(Hi) If the dual pair is not ( fffj ) in Section U~S[ thenAf is normal and dAf has codimension 
at least 2 in 77. □ 



3 Our base field is C so geometrically reduced (resp. geometrically normal) is equivalent to reduced 
(resp. normal). 
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Let O be a nilpotent K c -ovhit in p*. Let Z := W x p , O (resp. Y = W x p * O) be the 
scheme theoretic inverse image of O (resp. O). 

Lemma A. 8. (i) The scheme Z and Y are reduced, 
(ii) Suppose the dual pair is not ( Iff] ). Then Y is normal. If O is normal, then Z is 
normal. 

By the above lemma, we can also view Z = <fi~ l (0) and Y = 0~ 1 (O) as the set 
theoretical fibers. 

Proof, (i) Since 0: W -» p* is faithfully flat, <f>\ z : W x r O ->■ O is faithfully flat. 

Let i? r (resp. £" n ) be the set of elements in W which is geometrically reduced (resp. 
geometrically normal) in the fiber of 4>(w), i.e. 

E r := { w G W | w is reduced in W x p * 0(iu) } . 

By Theorem 12.1.6 in [6J, E r (resp. _E n ) is open in W. By Theorem IA.7( ii) and (iii), 
Jf C E r (resp. 77 C E n ). 

We claim that Z C -E r and Z G E n . We only prove Z G E r . The proof oi Z G E n is the 
same. Clearly i£ r is iT c x ^-invariant. It suffices to prove that E r contains every closed 
point z G Z. In order to show that z G E r , it suffices to show that E r H K C K' C ■ z 
Since 0: W — >• p* is an affine quotient map, it maps K c -invariant closed subset in W to 
closed subset in p* (see [2Z» Corollary 4.6]). Therefore 

<j)(K c K' c -z) = <j>{K c K' c -z) = K c <j>{z) 3 0. 

Hence ^ K C K' C ■ z n AT c K^K^z n ,E r . This proves our claim. 
We recall Proposition 11.3.13 in [6]. 

Proposition. Suppose f : X ^ Y is a finitely presented flat morphism, and y = f(x). 
Then x is reduced (resp. normal) in X if 
(i) y is reduced (resp. normal) in Y and 
(ii) x is reduced (resp. normal) in X x Y {y } ■ 

We continue with the proof of Lemma IA.81 Since O is reduced, Z G E r and the above 
proposition proves (i). Since O is smooth, it is normal (resp. O is normal by assumption). 
Y G Z G E n proves (ii). This completes the proof of Lemma [A. 81 □ 

We state a consequence of Lemma IA.8I 

Lemma A.9. O 7 = Z/K c , or equivalently, Cp 7 ] = (C[W] ® s(p) C[0]) Kc . 

Proof. By Lemma \KJRi), C[Z} Kc = (c[W] ® S ( P ) C[0]) Kc is reduced. The lemma follows 
from the fact that is an affine quotient map onto its image [3T]. Also see Proposition 3(2) 
in [26]. □ 

Let Z° be the open dense K c x i^-orbit in Y = (p'\0). Let dZ° = Y — Z°. By 
Theorem lA~4l (i). dZ° = R n Y where R = W - W° is the set of elements without full 
rank. 

Lemma A. 10. We have codim(F, dZ°) > 2. 

Proof. If dZ° = 0, then there is nothing to prove. Now suppose dZ° ^ 0. We reduce to 
consider irreducible components separately. Hence we assume all the schemes below are 
irreducible. 

Let J\ = </>~ 1 (0) be the closed null cone and let dH = AT — Af. It is known that 
dM = R n AT and codim(AT, dM) = dim 77 - dim dAf > 2. 
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We recall that Y is open dense in Z and <f>\z '■ Z — > O is faithfully flat. Therefore 

dim Y = dim Z = dim O + dim 77. 

By our assumption dZ° ^ 0. The map (plmz- R H Z — > O is dominant since its image 
contains O = 4>(dZ°). Moreover dN = (0| j Rnz) _1 (O). By the upper semi- continuity 
theorem of fiber dimension, 

dim dZ° < dim R n Z < dim + dim <9A/". 

Therefore 

codim(F, dZ°) = dimF - dim<9Z° > dim AT - dimdN > 2. 
This proves the lemma. □ 

Appendix B. Invariants of contragredient representations 

In this section, we state well-known facts about the invariants of contragredient repre- 
sentations. Since the proofs are not easily available elsewhere, we supply them as well. 

Let G be a real reductive group and let K be its maximal compact subgroup. Let (p, V) 
be (g, A^-module of finite length. Let (p*, V*) be its contragredient representation where 
V* = Hom(V A ,C)^_ finite . 

We recall the variety V C (V) associated to the annihilator ideal AnnV^ = Ann W ( B )V^. It 
is a subvariety in the nilpotent cone of q* cut out by the graded ideal Gr (Ann V). 

Proposition B.l. We have V C (V*) = V C (V). 

Proof. Let i be the anti-involution i on 14(g) such that i(X) = —X and l(XY) = YX 
for all X, Y 6 g. Passing to the graded module C[g*] = S(g) = Gv 14(g), Gr l is given 
by pre-composing the map on g* defined by g* 3 A i— >■ —A. Then t(Ann 7) = AnnV^* 
and V C (V*) = — V C (V). On the other hand, V C (V) is a union of nilpotent G c -orbits so 
V C (V") = — V C (V). This proves the proposition. □ 

B.2. In order to define the filtration on (p*,V*) we need to review [TJ. There is a 
Chevalley involution C E Aut(G) such that C(K) = K, Ad c (t) = fi and Ad c (p) = p. 
Furthermore for every semi-simple element g G G, C(g) is conjugate to g~ x in G. We 
define a representation (p c ,V c ) where V c = V and p c (k) = p(C(k)) for all k € K 
and p c (X) = p(Ad c (X)) for all C E U(g). We will call (p c ,V c ) the representation of 
(p,V) twisted by C. Corollary 1.2 in pQ states that (p c ,V c ) is isomorphic to the dual 
representation (p*,V*). 

Clearly, if O is a nilpotent A'c-orbit in p* generated by x, then A6.q(0) is a nilpotent 
A^c-orbit in p* generated by Ad^(x). Moreover, K^d^x) — C(K X ). For every ^-module 
(resp. A' x -character) Xx, Xx ° C is a Kj^ d ^^-modu\e (resp. Kx&* c { x ) -character). 

Proposition B.3. Let C E Aut(G) be the Chevalley involution. We have 

(i) AV(p*) = AdMAV(p)), 

(ii) AC(p*) = Ad^(AC(p)) ; 

(Hi) Suppose x E p* generates an open orbit in AV(p). Let \x be the isotropy character 
of K x at x. Then Xx ° C is the isotropy character at Ad^(x). 

Proof. Let Vj be an good filtration of (p, V). Then Vj is also a good filtration of (p c , V c ) 
since C(K) = K and Adc(g) = 0. Therefore, the (S(p),K c ) actions on GrV c is given 
by precomposing C, i.e. Gr V c = Gr V o C. This proves the lemma. □ 
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B.4. Let (p, V) be an irreducible (g, K)-module which is a quotient of . Let Vj = 
Uj{o)V T be the filtration generated by lowest degree If -type V^. By the definition of C, 
t o C\k = r*. We fix a (g, l£)-module isomorphism between V c and V*. Since V T has 
multiplicity 1 in V, V T * has multiplicity 1 in V* too. Therefore the filtration := Vj 
defined on V c is same as the filtration V* = Uj(g)V T * defined on V*. 
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